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In the claims: 

1 . (Currently Amended) A method comprising: 

reading a line of data from a file containing source code written in a high level 
language; 

generating a stream of tokens from said line of data, said stream of tokens 
representing any of a specific type of macro in saki the_line of data as being expanded 
while other types of macros are not expanded; 

generating a token object for each token, the token object in cluding a visibility 
variable to represent whether a parser and an output m odule may view the respective 
token; 

parsing sa& the stream of tokens using a parser and with reference to respective 
token objects: 

inserting commands representing operations to be performed by a macro into said 
stream of tokens if a macro is present; and 

writing oxpanded macro tokono to an output filo if paid macro io of aaid sp e cific 
typo of macro; and 

writing an original macro call to ooid output filo if Gaid macro is not Gaid specific 
typ e of macro 

writing the stream of tokens to an output file using an output module and with 
reference to respective token objects . 

2. (Currently Amended) The method of claim 1 , wherein said generating a 
stream of tokens further comprises: 

determining whether tokens are present in either an input file, a lookahead buffer, 
or a macro expansion list; and 

responsive to finding tokens, reading said the tokens first from said lookahead 
buffer, then from said macro expansion list, then from said input file; 
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presenting said thetokens to a parser so that any macro in &a& &S-line of data 
appears to have been expanded. 

3 . (Currently Amended) The method of claim 1 , wherein parsing further 

comprises: 

reading a token; 

determining a type of said Jhe r ead token; 

responsive to determining that said thcread token is an end-of-line, processing an 

input line of tokens; 

responsive to determining that sakl the read token is not a symbol, adding said 
read, token to a current line token list; 

responsive to determining that said the read token is a symbol that indicates a 
beginning of a macro definition, recording a macro name and said the_m acro definition 
and adding said the read token to a lookahead buffer; and 

responsive to determining that said the r ead token is a symbol that does not 
indicate a beginning of a macro definition, adding said Reread token to a current line 
token list. 

4. (Cancelled) 

5. (Currently Amended) The method of claim 1, wherein said source code 
written in a high level language comprises a hardware description language (HDL) for 
representing hardware designs. 

6. (Currently Amended) The method of claim 1 , wherein said specific type of 
macro comprises a scan macro. 

7. (Currently Amended) A method of scan insertion comprising: 
reading a hardware description language (HDL) representation of a hardware 

design, the HDL including a plurality of macro definitions some of which relate to scan 
insertion; 
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creating a token stream based on the HDL representation that includes 
multifaceted tokens that can be^hidden from or made visible to a subsequent parsing 
process by expanding the plurality of macro definitions and making tokens associated 
with scan macros visible to the subsequent parsing process and marking other tokens as 
hidd en 1 the multifaceted tokens being associated wi th a token object for efrQh token, the 
token object including a visibility vari able to represent whether a parser and an output 
module mav view the respective token and a scan variable to represent whether the 
respective token is rel ated to scan: 

performing scan insertion using a paiser by parsing those of the multifaceted 
mv^ c that *tp> visihle to the parser based on sa i4 visibility variable and adding 
appropriate scan commands; and 

using an output module to generate g en e rating a scan inserted HDL file 
containing expanded versions of the macro definitions which are visible to the output 
module based on the visibility variable and which relate to scan insertion but that omits 
expanded versions of those that do not relate to scan insertion based on the scan variable , 

8. (Currently Amended) The method of claim 7, wherein sai4 HDL 
comprises a high-level language. 

9. (Currently Amended) The method of claim 7, wherein said hardware 
design represents an integrated circuit design. 

10. (Currently Amended) A system comprising: 

a storage device having stored therein one or more routines for selectively 

expanding macros within source code; and 

a processor coupled to the storage device for executing the one or more routines 
for selectively expanding macros within source code which, when executing said thg 
routine: 
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reads a line of data from a file containing source cod© written in a high level 
language; 

generates a stream of tokens from said theline of data, said fbe_stream of tokens 
representing any of a specific type of macro in said thejine of data as being expanded 
while other types of macros are not expanded; 

generates a token object for each token, the token object including a visibility 
variable to represent whether a parser and an output module may vie w the respective 
token: 

parses said the stream of token s using a parser and with r eference to respective 
token objects ; 

inserts commands representing operations to be performed by a macro into said 
the s tream of tokens if a macro is present; and 

writes expanded macro tok e ns to on output fil e if said macro ia of said sp e cific 
type of macro; and 

writ e s an original maoro call to said output file if said macro is rot said specific 
typo of macro- writes the stream of tokens to an output file using an output module and 
with reference to respective token objects . 

1 1 . (Currently Amended) The system of claim 1 0, wherein eakl generating a 
stream of tokens further comprises: 

determining whether tokens are present in either an input file, a lookahead buffer, 
or a macro expansion list; and 

responsive to finding tokens, reading said the tokens first from said thelookahead 
buffer, then from said the m acro expansion list, then from said thg_input file; 
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presenting said the tokens to a parser so that any macro in said fegJine of data 
appears to have been expanded. 

12. (Currently Amended) The system of claim 10, wherein said parsing 

further comprises: 
reading a token; 

determining a type of said the r ead token; 

responsive to determining that said theread token is an end-of-line, processing an 
input line of tokens; 

responsive to detennining that ea*4 die read token is not a symbol, adding said the 
read token to a current line token list; 

responsive to determining that said ther ead token is a symbol that indicates a 
beginning of a macro definition, recording a macro name and said the m acro definition 
and adding said the r ead token to a lookahead buffer; and 

responsive to determining that said ther ead token is a symbol that does not 
indicate a beginning of a macro definition, adding said theread token to a current line 
token list 

13. (Canceled) 

14. (Currently Amended) The system of claim 1 0, wherein said source code 
written in a high level language comprises a hardware description language 
(HDL) for representing hardware designs. 

1 5. (Currently Amended) The system of claim 1 0, wherein said specific type 
of macro comprises a scan macro. 

16. (Currently Amended) A machine-readable medium having stored thereon 
data representing sequences of instructions, the sequences of instructions which, when 
executed by a processor, cause the processor to selectively expand macros by: 

reading a line of data from a file containing source code written in a high level 
language; 
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generating a stream of tokens from said theline of , said &£_stream of tokens 
representing any of a specific type of macro in eaid- thejine of data as being expanded 
while other types of macros are not expanded; 

generating a token object for each token, the token object including a visibility 
v iable to represent whether a parser and an output mo dule may view the respective 
token; 

parsing said the stream of tokens using a parser and with re ference to respective 
token objects : 

inserting commands representing operations to be performed by a macro into said 
the stream of tokens if a macro is present; and 

writing expanded macro tokono to an output file if said macro ic of said sp e cific 
typ e of macro; and 

writing on original macro call to said output fil e if said macro is not said specific 
typo of macro, writing the stream of tokens to an output file using an out put module and 
with reference to respective token objects . 

17. (Currently Amended) The machine-readable medium of claim 16, wherein 
said generating a stream of tokens further comprises: 

determining whether tokens are present in either an input file, a lookahead buffer, 
or a macro expansion list; and 

responsive to finding tokens, reading said the t okens first from said thelookahead 
buffer, then from said the m acro expansion list, then from said the input file; 

presenting said the t okens to a parser so that any macro in said the l ine of data 
appears to have been expanded. 

1 8. (Currently Amended) The machine-readable medium of claim 1 6, wherein 
said parsing further comprises: 

reading a token; 

determining a type of said the r ead token; 
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responsive to determining that «*& the read token is an end-of-Iine, processing an 
input line of tokens; 

responsive to determining that aa*i theread token is not a symbol, adding said the 
read token to a current line token list; 

responsive to determining that said theread token is a symbol that indicates a 
beginning of a macro definition, recording a macro name and macro definition and 
adding said the read token to a lookahead buffer; and 

responsive to determining that said the r ead token is a symbol that does not 
indicate a beginning of a macro definition, adding said the r ead token to a current line 
token list. 

19. (Cancelled) 

20. (Currently Amended) The machine-readable medium of claim 16, wherein 
said source code written in. a high level language comprises a hardware description 
language (HDL) for representing hardware designs. 

21 . (Currently Amended) The machine-readable medium of claim 1 6 f wherein 
said specific type of macro comprises a scan macro. 
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22. (Currently Amended) A machine-readable medium having stored thereon 
data representing sequences of instructions, the sequences of instructions which, when 
executed by a processor, cause the processor to perform scan insertion by: 

reading a hardware description language (HDL) representation of a hardware 
design, the HDL including a plurality of macro definitions some of which relate to scan 
insertion; 

creating a token stream based on the HDL representation that includes 
multifaceted tokens that can be hidden from or made visible to a subsequent parsing 
process by expanding the plurality of macro definitions and making tokens associated 
with scan macros visible to the subsequent parsing process and marking other tokens as 
hidde n, the multifaceted tokens being associated with a token object for each token, the 
token object including a visibility variable to represent whetber a parser and an output 
module may view the respective token and a scan variable to represent whether the 
respective token is related to scan: 

performing scan insertion using a parser by parsing those of the multifaceted 
tokens that are visible to the parser based on the visibility variable and adding appropriate 
scan commands; and 

using an output module to generate g e n e rating a scan inserted HDL file 
containing expanded versions of the macro definitions which are visible to the output 
module based on the visibility variable and which relate to scan insertion but that omits 
expanded versions of those that do not relate to scan insertion based on the scan variable . 

23. (Currently Amended) The machine-readable medium of claim 22 > wherein 
said HDL comprises a high-level language. 

24. (Currently Amended) The machine-readable medium of claim 22, wherein 
said hardware design represents an integrated circuit design. 
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25. (New) The method of claim 1 , wherein writing comprises: 

writing expanded macro tokens to the output file if the macro is of the specific 
type of macro; and 

writing an original macro call to the output file if the macro is not the specific 
type of macro. 

26. (N ew ) The machine-readable medium of claim 16 3 wherein writing 
comprises: 

writing expanded macro tokens to the output file if the macro is of the specific 
type of macro; and 

writing an original macro call to the output file if the macro is not the specific 
type of macro. 

27. (New) A token object for use by a parser module of an automated scan 
insertion tool, the token object comprising: 

a token type indicating a type for the token; 

a token string containing the text of the token; and 

an "IsScan" variable indicating whether the token is related to scan insertion. 

28. (New) The token object of claim 27, further comprising a hidden token 
type indicating that the token is to be hidden from the parser. 

29. (New) The token object of claim 27, further comprising a hidden token 
string containing the text of the token that is to be hidden from the parser. 

30. (New) The token object of claim 27, further comprising a visibility 
variable indicating which parts of the automated scan insertion tool may view the token. 

31. (New) The token object of claim 30, wherein the parts of the automated 
scan insertion tool include the parser and an output module. 
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32. (New) The token object of claim 27, wherein the M IsScan" variable 
indicates whether the token is related to adding observation points to an electronic 
hardware design representation- 
SB. (New) A method comprising: 

reading lines of a hardware description language (HDL) representation of a 
hardware design, the HDL lines including a plurality of macro definitions some of which 
relate to scan insertion, 

creating a token stream based on the HDL representation, each token including an 
IsScan variable to indicate whether the respective token is related to scan insertion; 

performing scan insertion by parsing those of the tokens that are related to scan 
and adding scan commands; and 

generating a scan inserted HDL file containing expanded versions of the macro 
definitions which relate to scan insertion but omitting expanded versions of the macro 
definitions that do not relate to scan insertion. 

34. (New) The method of claim 33, wherein creating a token stream comprises 
creating tokens that include a hidden token type variable to define whether the token is to 
be hidden from or made visible to a subsequent parsing process. 

35. (New) The method of claim 33, wherein the HDL is a high-level 
language. 

36. (New) The method of claim 33, wherein the hardware design represents an 
integrated circuit design. 

37. (New) The method of claim 33, wherein generating comprises: 
receiving a token from a scan insertion module; 
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determining whether the token involves scan related changes; and 

writing the token to an output file if the token is not scan related. 

38. (New) The method of claim 33, further comprising determining whether 
more tokens are to be received from the scan insertion module and repeating determining 
whether the token involves scan related changes and writing the token to an output file 
until no tokens remain . 

3 9. (New) The method of claim 33 , wherein creating a token stream 

comprises: 

reading an HDL line from the HDL representation; 
storing the lines in a lookahead list; 

expanding macros that are related to scan and storing the expanded macros in a 
macro expansion list; 

reading tokens first from the lookahead list, then from the macro expansion list, 
and then from the HDL file; and 

passing the read tokens for parsing as if all the macros have been expanded. 

40. (New) The method of claim 33, wherein creating a token stream comprises 
expanding the included macros that are related to scan and storing the expanded macros 
in a macro expansion list before passing the tokens for parsing as if all the macros have 
been expanded. 

41 . (New) The method of claim 33, wherein generating comprises writing the 
scan inserted tokens into the HDL file from a buffer that preserves the text of the original 
file. 

42. (New) The method of claim 33, further comprising parsing the tokens by: 
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determining whether a token is a macro name; and 

expanding the token and added it to an expanded macro list if the token is a macro 

name; 

43 . (New) The method of claim 42 wherein parsing further comprises: 
processing the token if the token is an end-of-line character; 

adding the token to a current line token list if the token is found to be anything 

other than a symbol; 

recording the macro name and definition in a lookahead buffer if the token is a 
symbol that begins a macro definition; and 

adding the token to a current line token list if the token is a symbol does not begin 
a macro definition. 

44. (New) A machine-readable medium having stored thereon data 
representing sequences of instructions that, when executed by a machine, cause the 
machine to perform operations comprising: 

reading lines of a hardware description language (HDL) representation of a 
hardware design, the HDL lines including a plurality of macro definitions some of which 
relate to scan insertion; 

creating a token stream based on the HDL representation, each token including an 
IsScan variable to indicate whether the respective token is related to scan insertion; 

performing scan insertion by parsing those of the tokens that are related to scan 
and adding scan commands; and 
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gentling a scan inserted HDL file containing expanded versions of the macro 
definitions which relate to scan insertion but omitting expanded versions of the macro 
definitions that do not relate to scan insertion. 

45. \ (New) The machine-readable medium of claim 44, wherein creating a 
token stream comprises creating tokens that include a hidden token type variable to 
define whether the token is to be hidden from or made visible to a subsequent parsing 
process. 

46. (New) The machine-readable medium of claim 44, wherein generating 
comprises: 

receiving a token from a scan insertion module; 

determining whether the token involves scan related changes; and 

writing the token to an output file if the token is not scan related. 

47. (New) The machine-readable medium of claim 44 ? wherein creating a 
token stream comprises: 

reading an HDL line from the HDL representation; 
storing the lines in a lookahead list; 

expanding macros that are related to scan and storing the expanded macros in a 
macro expansion list; 

reading tokens first from the lookahead list, then from the macro expansion list, 
and then from the HDL file; and 

passing the read tokens for parsing as if all the macros have been expanded. 
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48. (New) The machine-readable medium of claim 44, wherein generating 
comprises writing the scan inserted tokens into the HDL file from a buffer that preserves 
the text of the original file. 

49. (New) A scan insertion tool for a semiconductor hardware description 

language comprising: 

a tokenizer module to read lines of an (HDL) representation of a hardware design, 
the HDL lines including a plurality of macro definitions some of which relate to scan 
insertion and to create a token stream based on the HDL representation, each token 
including an IsScan variable to indicate whether the respective token is related to scan 
insertion; 

a scan insertion module to perform scan insertion by parsing those of the tokens 
that are related to scan and adding scan commands; and 

a file output module to generate a scan inserted HDL file containing expanded 
versions of the macro definitions which relate to scan insertion but omitting expanded 
versions of the macro definitions that do not relate to scan insertion. 

50. (New) The tool of claim 49, further comprising a parsing module to 
determine whether a token is a macro name* and to expand the token and add it to an 
expanded macro list if the token is a macro name. 

5 1 . (New) The tool of claim 50 wherein the parsing module is further to 
process the token if the token is an end-of-line character, to add the token to a current line 
token list if the tokeo is found to be anything other than a symbol, to record the macro 
name and definition in a lookahead buffer if the token is a symbol that begins a macro 
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definition, and to add the token to a current line token list if the token is a symbol that 
does not begin a macro definition- 

52. (New) The tool of claim 50, wherein the tokenizer module creates tokens 
that include a hidden token type variable to define whether the token is to be hidden from 
or made visible to the parsing module. 

53. (New) The tool of claim 49, wherein the tokenizer module is further to 
read an HDL line from the HDL representation, to store the lines in a lookahead list, to 
expand macros that are related to scan and store the expanded macros in a macro 
expansion list, to read tokens first from the lookahead list, then from the macro expansion 
list, and then from the HDL file, and to pass the read tokens to the parsing module as if 
all the macros have been expanded. 

54. (New) The tool of claim 49, wherein the file output module is further to 
receive a token from a scan insertion module, to determine whether the token involves 
scan related changes, and to write the token to an output file if the token is not scan 
related. 
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